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BACKGROUND OF THE INVENTION 

"15 1 . Technical Field 

The inventive arrangements relate generally to methods and apparatus 
1 providing advanced operating features for programs recorded on disc media, for 

example recordable digital video discs, hard drives and magneto optical discs. 
20 2. Description of the Related Art 

Various devices have been developed to enable consumers to record video 
and/or audio programs for later presentation. Such devices include tape 
recorders, video cassette recorders, recordable compact discs, and most 
recently, recordable digital video discs (DVD). Hard drives and magneto optical 
25 discs have also been used. 

A DVD that can be recorded on only once, and thereafter is essentially a 
DVD read only memory, is referred to by the acronym DVD-R. The acronym 
DVD-R is also generally used to refer to write-once, or record-once, technology. 
Several formats are available for DVD's to be recorded on, erased and re- 
30 recorded; that is, overwritten or rewritten. These are referred to by the 

acronyms DVD-RAM, DVD-RW and DVD-l-RW. As of this time no uniform 
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industry standard has been adopted. The acronyms DVD-RAM, DVD-RW and 
DVD + RW are also used generally to refer to the respective rewritable 
technologies. Reference herein to rewritable DVD technology, devices and 
methods is generally intended to encompass all of the standards which are now 
being used, as well as those which may be developed in the future. 

Once video is recorded onto a disc, a user may desire to change the speed 
at which the video is displayed. To meet this demand, most conventional DVD 
recorders are designed to playback the video at different speeds. For example, 
these devices can generally playback video at fast-forward or slow-motion 
speed. These playback variations are commonly referred to as trick modes. 
Typically, a DVD recorder performs these trick modes by repeating or deleting 
one or more pictures contained in the recorded video after the video has been 
read from the disc. For example, in the slow motion trick mode, a DVD recorder 
can repeat every picture from a particular portion of recorded video to give the 
viewer the impression that the video is being displayed at one-half its normal 
speed. To produce fast-forward playback, the DVD recorder can delete one or 
more pictures from the video during playback. 

While trick modes enable a user to view recorded video at different 
speeds, the video is not permanently altered by the process. If the video is 
displayed at a later time, then the user must initiate another trick mode to view 
the video at a different speed. Significantly, however, many users may wish to 
permanently change the playback speed of a particular portion of video by 
modifying the video once the video has been recorded onto a disc. Such a 
process can permit speed variations during playback without the user invoking a 
trick mode command. Unfortunately, several significant obstacles exist that 
make editing recorded video in such a fashion impracticable. Specifically, the 
space occupied by the original video is not large enough to store the pictures 
that must be repeated in order to produce slow motion playback. In addition to 
spatial limitations, repeating pictures on the disc can interfere with the 
conventional picture structure of the video, which can degrade the display 
quality of the video during playback. 
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Modifying recorded video to produce fast-forward playbacl<, however, is 
not affected by the spatial limitations that Impede slow-motion editing. This is 
because fast-forward editing merely deletes pictures form the recorded video. 
Nevertheless, creating fast-forward video, similar to slow-motion modification, 
also negatively impacts the conventional picture structure of the video. Thus, 
what is needed is a device that can change the playback speed of recorded 
video yet can overcome the spatial and structural limitations associated with 
such recorded video. 

Summary of the Invention 

In a rewritable storage medium, the invention includes a method for 
changing a playback speed of a selected video segment having a progressive 
frame structure which has been recorded on a portion of the storage medium. In 
one arrangement, the invention includes the steps of: modifying the selected 
video segment for a changed playback speed; and recording the modified video 
segment exclusively on the portion of the medium. The invention can also 
include the step of deleting a plurality of non-video packs in the selected video 
segment to reduce the amount of data contained in the modified video segment. 
Further, the invention can also include the step of reducing a resolution of at 
least one frame contained in the modified video segment. The invention can 
also include the step of lowering a bit rate of the modified video segment during 
the recording step. 

In one arrangement of the above invention, the video segment can be 
comprised of intra and non-intra frames and the modification can comprise the 
step of decoding each intra frame and selectively decoding at least one non-intra 
frame. The invention can also include the step of inserting into the selected 
video segment at least one of the group consisting of dummy pictures and 
repeat pictures. In one aspect, the number of dummy pictures and repeat 
pictures inserted into the selected video segment can be based on the changed 
playback speed. In another arrangement, the invention can also include the step 
of selectively decoding and re-encoding the modified video segment for 
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conventional placement of the dummy pictures, the repeat pictures, and the intra 
and non-intra frames. 

In another arrangement of the above method, the video segment can 
include intra and non-intra frames and the modification can include the step of 
5 decoding all intra and non-intra frames. In addition, in this arrangement, the 

invention can include the step of inserting at least one of the group consisting of 
dummy pictures and repeat pictures into the selected video segment. In another 
aspect, the number of dummy pictures and repeat pictures inserted into the 
selected video segment can be based on the changed playback speed. 

10 In another arrangement of the above method, the video segment can 

include intra and non-intra frames and the modification can include the step of 
removing at least one frame from the group consisting of intra and non-intra 
frames. Alternatively, the video segment can include intra and non-intra frames 
and the modification can include the steps of: decoding the intra and non-intra 

si 5 frames; and removing at least one field from at least one of the intra and non 
intra frames. 

In another arrangement, the invention includes a system for changing a 
playback speed of a selected video segment having a progressive frame 
structure recorded on a rewritable storage medium. The above system includes: 

20 storage medium reading circuitry for selectively reading a video segment which 
has been recorded on a portion of the rewritable storage medium; and a video 
processor for modifying the selected video segment for a changed playback 
speed; and video recorder circuitry for recording the modified video segment 
exclusively on the portion of the storage medium. In one aspect, the video 

25 processor can delete a plurality of non-video packs in the selected video 

segment to reduce the amount of data contained in the modified video segment. 
Further, the video processor can reduce the resolution of at least one frame 
contained in the modified video segment and can lower the bit rate of the 
modified video segment during the recording step. 

30 In one arrangement of the above system, the video segment can include 

intra and non-intra frames, and the video processor can decode each intra frame 
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and can selectively decode at least one non-intra frame. In addition, the video 
processor can insert into the selected video segment at least one of the group 
consisting of dummy pictures and repeat pictures. Further, the number of 
dummy pictures and repeat pictures inserted into the selected video segment 
can be based on the changed playback speed, in addition, the video processor 
can selectively decode and reencode the modified video segment for 
conventional placement of the dummy pictures, the repeat pictures and the intra 
and non-intra frames. 

In another arrangement of the above system, the video segment can 
include intra and non-intra frames and the video processor can decode all the 
intra and non-intra frames. Further, the video processor can insert at least one 
of the group consisting of dummy pictures and repeat pictures into the selected 
video segment. In this particular arrangement, the number of dummy pictures 
and repeat pictures inserted into the selected video segment can be based on 
the changed playback speed. 

In another aspect of the above system, the video segment can include 
intra and non-intra frames and the video processor can remove at least one 
frame from the group consisting of the intra and non-intra frames. Alternatively, 
the video processor can: decode the intra and non-intra frames; and remove at 
least one field from at least one of the intra and non-intra frames. 

Brief Description of the Drawings 

FIG. 1 is a block diagram of a rewritable DVD device that can change the 
playback speed of video recorded in a progressive frame structure format in 
accordance with the inventive arrangements herein. 

FIG. 2 illustrates the spiral track on a rewritable DVD disc. 

FIG. 3 illustrates a data structure of the rewritable DVD disc of FIG. 2. 

FIG. 4A is a flow chart that illustrates the operation of changing the 
playback speed of a video presentation recorded in a progressive frame structure 
format to produce slow motion playback. 

FIGS. 4B - 4G demonstrate the editing process of FIG. 4A as applied to a 
conventional GOP to produce a one-half playback speed. 
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FIG. 5 A is a flow chart that illustrates an alternative arrangement for 
changing the playback speed of a video presentation recorded in a progressive 
frame structure format to produce slow motion playback. 

FIGS. 5B - 51 demonstrate the editing process of FIG. 5A as applied to 
two conventional GOP's to produce a one-half playback speed. 

FIG. 6A is a flow chart that illustrates a process for changing the playback 
speed of a video presentation recorded in a progressive frame structure format 
to produce fast motion playback. 

FIGS. 6B - 6F demonstrate the editing process of FIG. 6A as applied to 
two conventional GOP's to produce a doubled playback speed. 

FIG. 7A is a flow chart that illustrates an alternative arrangement for 
changing the playback speed of a video presentation recorded in a progressive 
frame structure format to produce fast motion playback. 

FIGS. 7B - 7D demonstrate the editing process of FIG. 7A as applied to 
two conventional GOP's to produce a doubled playback speed. 

Detailed Description of the Preferred Embodiments 
Recordable DVD Device 

A device 1 00 for implementing the various advanced operating features in 
accordance with the inventive arrangements is shown in block diagram form in 
FIG. 1 . A rewritable disc medium is embodied as a rewritable DVD in the 
illustrated embodiment. In many instances, as will be noted, the rewritable disc 
medium can also be, for example, a hard drive or a magneto optical disc (MOD). 
An example of a MOD is a mini-disc. Moreover, the invention can be used in a 
digital tape machine. In fact, the invention can be used in any other suitable 
storage medium device. 

The device 100 is capable of writing onto and reading from the disc 
medium, in this example, a rewritable DVD 102. Although the following 
discussion primarily concerns a rewritable DVD, the invention is not so limited. 
As noted earlier, the invention can be used with any other suitable storage 
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medium. The device can comprise a mechanical assembly 104, a control 
section 120, a video/audio input processing path 140 and a video/audio output 
processing path 1 70. The allocation of most of the blocks to different sections 
or paths is self-evident, whereas the allocation of some of the blocks is made for 
purposes of convenience and is not critical to understanding the operation of the 
device. 

The mechanical assembly 104 can include a motor 106 for spinning the 
disc 102 and a pickup assembly 108 that can be adapted to be moved over the 
disc 102 as the disc 102 spins. A laser on the pickup assembly 108 can burn 
spots onto a spiral track on the disc 1 02 and can illuminate spots already burned 
onto the track for recording and playing back video and/or audio program 
material. For purposes of understanding the invention, it is irrelevant whether 
the disc 102 is recordable on one or two sides, or in the event of a double-sided 
recording, whether the double-sided recording, or subsequent reading from the 
disc 102, takes place from the same side of the disc 102 or from both sides. 
The pickup assembly 108 and the motor 106 can be controlled by a servo 110. 
The servo 1 10 can also receive the Playback Signal of data read from the spiral 
track of the disc 102 as a first input. The Playback Signal is also an input to an 
error correction circuit 1 30, which can be considered part of the control section 
or part of the video/audio output processing path 1 70. 

The control section 1 20 can comprise a control central processing unit 
(CPU) 122 and a navigation data generation circuit 126. The control CPU 122 
can supply a first input signal to the navigation data generation circuit 1 26, and 
the servo 1 10 can supply a second input signal to the navigation data generation 
circuit 1 26. The servo 1 10 can also be considered part of the control section 
1 20. The navigation data generation circuit 1 26 can supply a first input signal 
to the multiplexer (MUX) 1 54, which can form part of the video/audio input 
processing path 140. 

The output of the MUX 154 can be an input to an error correction coding 
circuit 128. The output of the error correction coding circuit 128 can be a 
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recordable input signal supplied to the pickup 108, which can be "burned" onto 
the spiral track of the disc 102 by the laser. 

In addition, control and data interfaces can also be provided for permitting 
the CPU 122 to control the operation of the video encoder 144, video decoder 
178 and audio decoder 182. Suitable software or firmware can be provided in 
memory for the conventional operations performed by control CPU 122. 
Further, program routines for the editing recorded video features 1 34 are 
provided for controlling CPU 122 in accordance with the inventive arrangements. 
A control buffer 1 32 for viewer activatable functions can indicate those 
functions presently available, namely play, record, reverse, fast forward, slow 
play, jump, pause/play and stop. In addition, an editing buffer 1 36 can be 
provided to receive commands for implementing the recorded video editing 
features. 

The output processing path 1 70 can comprise an error correction block 
130, a track buffer 172, a conditional access circuit 174 and a demultiplexer 
1 76. The track buffer 1 72 can read and temporarily store for further processing 
data read from the disc 102. This data can be processed by the conditional 
access circuit 1 74, which can control propagation of the data through the 
demultiplexer 176 and into respective paths for video and audio processing. 
Additionally, the output processing path 1 70 can include a packet video encoder 
178, a TV encoder 180, an audio decoder 182 and an audio D/A 184. 

The video/audio input processing path 140 can be a signal processing 
circuit for converting a conventional television signal into digitized packet data 
for digital recording by the device 100. The input path 140 can include a TV 
decoder 142 and the packet video encoder 144. In addition, the input 
processing path 140 can include an audio A/D 146 and an audio encoder 148. 
During normal operation, the digitized signals can be combined in a multiplexer 
1 50 and can then be stored in the record buffer 1 52 until an entire packet has 
been constructed. As groups of audio and video data packets are created, they 
can be combined in multiplexer 1 54 with appropriate navigation packets 
generated in the navigation generation block 126. The packets can then be sent 
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to the error correction coding circuit 128. Error correction coding circuit 128 
can also be deemed to be part of the input path 140. 

If a user wishes to edit a portion of video stored on the disc 102, the 
editing buffer 136 can signal the control CPU 122. In one arrangement, the 
5 control CPU 1 22 can signal the packet video encoder 1 78 to decode the pictures 
contained in the video and then to send the video containing the decoded 
pictures to a packet video encoder 144. As will be explained later, in an 
alternative arrangement, only a selected number of these pictures need to be 
decoded during the editing process. In either arrangement, any audio associated 

10 with the pictures can be forwarded to the audio decoder 182. The control CPU 
1 22 can then instruct the audio decoder 1 82 to store the audio temporarily. For 
purposes of creating extra space, however, the audio is generally not 
recombined with the video during the editing process. Rather, the audio is 
typically lost when the storage buffer in the audio decoder 1 82 overflows. 

35 Conversely, once the editing process is completed, any audio associated with 
the edited video that remains in the audio decoder's 1 82 storage buffer can be 

r overwritten with audio intended to be played. In addition to removing the audio 

£ component, any subpicture information associated with the modified video can 

=- be separated and prevented from reintegrating with the modified video. 

20 Once the video signal containing the decoded pictures is received at the 

packet video encoder 144, the video encoder 144 can modify the video signal 
by adding or deleting pictures. As will be explained in detail below, adding 
pictures to the video signal can create slow-motion video and deleting pictures 
from the video can produce fast-forward video. The video encoder 144 can 

25 then re-encode these pictures so that the modified video can be placed on the 
disc 102. 

After the pictures in the edited video signal have been re-encoded, the 
video signal can merely propagate through the multiplexer 1 50 since audio is 
typically not combined with the modified video signal. The edited video is then 
30 processed in a fashion similar to that of normal video. That is, the modified 
video signal is combined with navigation data in the multiplexer 154 and error 
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corrected by error correction coding circuit 128. As will be explained later, the 
edited video signal can then be recorded back onto the disc 102 in its original 
space. 

Notably, the present invention can be realized in hardware, software, or a 
5 combination of hardware and software. Machine readable storage according to 
the present invention can be realized in a centralized fashion in one computer 
system, for example the control CPU 1 22, or in a distributed fashion where 
different elements are spread across several interconnected computer systems. 
Any kind of computer system or other apparatus adapted for carrying out the 

10 methods described herein is acceptable. 

Specifically, although the present invention as described herein 

- contemplates the control CPU 122 of FIG. 1, a typical combination of hardware 
and software could be a general purpose computer system with a computer 
program that, when being loaded and executed, controls the computer system 

15 and a DVD recording system similar to the control section 1 20 of FIG. 1 such 
that it carries out the methods described herein. The present invention can also 
be embedded in a computer program product which comprises all the features 
enabling the implementation of the methods described herein, and which when 
loaded in a computer system is able to carry out these methods. 

20 A computer program in the present context can mean any expression, in 

any language, code or notation, of a set of instructions intended to cause a 
system having an information processing capability to perform a particular 
function either directly or after either or both of the following: (a) conversion to 
another language, code or notation; and {b) reproduction in a different material 

25 form. The invention disclosed herein can be a method embedded in a computer 
program which can be implemented by a programmer using commercially 
available development tools for operating systems compatible with the control 
CPU 1 22 described above. 

DVD Media 

30 For purposes of illustrating the inventive arrangements, program material 

can be recorded onto a rewritable DVD and played back from a rewritable DVD. 
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A rewritable DVD 10 shown in FIG. 2 is suitable for use as disc 102 in device 
100. The disc 10 is formed by a flat, round plastic plate-like member 12. The 
re-writable DVD can consist of two substrates bonded together by an adhesive 
layer forming a 1 .2mm thick disk. A center hole 14 can be formed in the disk 
so that a gripping device of the motor 106 of FIG. 1 can securely grip the disk 
and control the angular motion of the same in accordance with the inventive 
arrangements. 

The direction of recording on the track is typically outwardly along a spiral 
track 1 6, from a smaller radius part of the spiral to a larger radius part of the 
spiral. The several series of three large dots ( • • • ) denote portions of the track 
not shown in the drawing. As a result, the beginning of the spiral track is 
deemed to be near the hole 14 and is denoted by square 1 8. The end of the 
spiral is deemed to end near the rim and is denoted by diamond 20. Those 
skilled in the art generally accept defining the beginning and end of the spiral as 
noted. The track can also have a side-to-side wobble, not shown in the 
drawing, to accommodate media type indexing. Due to difficulties of scale, only 
portions of the track 1 6 are shown, and these are shown in greatly enlarged 
scale. 

Each nearly circular, radially concentric section of the spiral is sometimes 
referred to as a track, but this terminology is not commonly accepted as having 
that specific meaning. In CD-ROM's, for example, the term track is also used to 
refer to that portion of the spiral track that contains a single audio song, or other 
selection, and the same may or may not become common for DVD's. 

DVD Data Structure 

As shown in FIG. 3, each DVD contains a video manager 26 and a video 
title set (VTS) 28. The VTS includes video title set information (VTSI) 27, an 
optional video object set for menu 29, one or more VOBS for title 30 which 
contains the actual title content and a VTSI backup 31 . Each VOBS 30 is 
comprised of a plurality of video objects (VOB) 32. Each video object 32 
includes a plurality of cells 34. Each VOBS 30 also includes a collection of 
pointers to one or more cells. In this way, the VOBS 30 data links the cells 34 
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together and indicates in what order the programs or cells 34 are to be played. 
The cells 34 within a particular VOBS 30 can be flagged for play in any desired 
order. For example, they can be played sequentially or randomly. 

Each cell 34 includes a plurality of video object units (VOBU) 36. Each of 
5 the VOBU's 36 in which the video content of the disc resides typically contains 
0.4 to 1 .0 seconds of presentation material. Each VOBU starts with exactly one 
navigation pack (NV PCK) 38 and can include one or more audio packs (A_PCK) 
40, one or more video packs (V_PCK) 41 and one or more subpicture packs 
(SP PCK) 42. In addition, each VOBU 36 Is nominally comprised of one group 
10 of pictures (GOP). 

Changing Playback Speed for Video Presentation Recorded in a Progressive 
Frame Structure Format 
In accordance with the inventive arrangements, a user may alter the 
playback speed of progressive frame video that has already been recorded onto a 
1 5 storage medium. If the user desires to edit the recorded video to produce slow 
motion video, then one or more pictures may be inserted into the video to create 
such an effect. The altered video can then be recorded onto the storage 
medium in the same space previously occupied by the original video. If the user 
desires to create fast-forward video, then one or more pictures may be removed 
20 from the recorded video. Similar to the slow motion editing process, the video 
can be recorded in the original video's medium space. In either process, the 
edited video may be re-encoded to produce higher quality playback and trick 
mode operation. 

The following is a typical GOP structure in an MPEG video stream 
25 recorded under a progressive scanning format, which can be helpful in explaining 
the inventive arrangements: 

Bo Bi h B3B4 Pb BsB? Ps Be Bio P11 B12 B13P14 
As shown, MPEG video generally uses three types of picture storage methods: 
Intra (I) frames, predicted (P) frames and bidirectional predicted (B) frames. The 
30 P frames and B frames are commonly referred to as non-intra (non-1) frames. I 

frames are encoded or decoded independent of any other picture. This creates a 



PU010092 13 

reference frame from which non-1 frames can be constructed. To reduce the 
amount of information needed to be encoded in a particular GOP, each GOP 
usually contains only one I frame. 

P frames contain motion vectors which describe the difference from the 
5 closest previous I frame or P frame. In contrast to I frames, only the differences 
between the current P frame and the closest previous i frame or P frame are 
encoded. B frames contain motion vectors that describe the difference from the 
closest previous I frame or P frame as well as the closest subsequent I frame or 
P frame. Similar to P frames, only the differences between the current B frame 
10 and the relevant I frames or P frames are encoded or decoded. 
O Although a GOP can contain from one to eighteen pictures, a typical GOP 

m comprises fifteen frames. Moreover, placing two B frames between each I 
JvJ frame and P frame or between a P frame and another P frame produces 

smoother playback in addition to improved trick mode performance. As a result, 
XB it is desirable to have each GOP in a video signal in conformity with the 
Q conventional GOP structure reproduced above, particularly if the video is to be 
r recorded back onto a suitable storage medium. 

It should be noted, however, that the GOP structure selected for purposes 
M of illustrating the inventive arrangements herein is merely an example of a GOP 
20 structure that can be used to practice the invention, as the invention is not 
limited to any particular type of GOP structure. In fact, the invention can be 
applicable to those MPEG encoders that are designed to create only P frames 
and I frames or those encoders that are limited to produce only I frames. 

Referring to FIG. 4A, a flowchart 400 illustrates how slow motion editing 
25 can be performed. In this arrangement, it is preferable to limit the number of 

pictures that are to be decoded and subsequently re-encoded. FIGS. 4B through 
4G illustrate an example of this slow motion editing process. In particular, FIGS. 
4B through 4G demonstrate how a single conventional GOP can be altered to 
produce a one-half playback speed; however, it should be noted that the 
30 invention is not so limited, as any portion of video may be changed to playback 
at any speed slower than normal playback. 
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Beginning at step 410 in FIG. 4A, the device 100 can begin to read data 
from the storage medium. In step 412, the demultiplexer 176 of FIG. 1 can 
separate the video component of the recorded video signal from the non-video 
components, such as A PCK's 40 and SP_PCK's 42. The NV_PCK's 38, 
5 however, can be left in the video signal being edited. The non-video 

components can then be discarded. FIG. 4B illustrates a conventional GOP 
following this process. 

As shown in step 414 and in accordance with the inventive 
arrangements, only a selected number of pictures need to be decoded. In one 
IQ arrangement, each I frame in the video signal can be decoded. In addition, since 
adding pictures to the video signal to produce a slower playback will create the 
need to form new GOP's, one or more other non-1 frames can be decoded 
S[ thereby enabling such pictures to be re-encoded into I frames, or as will be 
^ explained below, I field and P field pictures. This procedure ensures that each 
15 new GOP will have at least one I frame, or at least one I field and P field 
r-: combination, from which to produce the P and B frames. 

^ At step 41 6, the pictures that were decoded in step 41 4 can now be re- 

O encoded. As an example, the I frames that were decoded in step 414 can be re- 
encoded into an I field picture and a P field picture. This process is shown in 

20 FIG. 4C. As is known in the art, a complete frame includes two field pictures. 
Accordingly, an individual field picture will contain less information 
(approximately 50% less) than a complete frame. Re-encoding each I frame into 
two I field pictures does not necessarily reduce the amount of information that 
must be stored on the storage medium; however, re-encoding each I frame into 

25 an I field picture and a P field picture helps reduce the amount of information 
needed to be stored on the medium since a P field picture requires less storage 
space than an I field picture. It should be noted, however, that the invention is 
not so limited, as the I frames can be re-encoded into any other suitable format. 
Any other pictures that were decoded in step 414 can be re-encoded into 

30 an I frame, or preferably, an I field picture and P field picture. This ensures that 
any new GOP's will have the necessary reference frame or fields to display the 
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remaining P frames and B frames. FIG. 4D shows an example of this process, 
as frame Ps is re-encoded into field pictures IsPs. It should be noted, however, 
that FIG. 4D is merely an example, as any other frame can be selected for 
decoding and subsequent re-encoding. Moreover, similar to the decoded and re- 
5 encoded I frames, any frames selected for decoding under this process are not 
limited to being re-encoded into I field and P field pictures, as such frames can 
be re-encoded into any other suitable format. 

Moving to step 418 in FIG. 4A, if dummy pictures are to be added to the 
video being edited, then the packet video encoder 144 can insert one or more 

10 such pictures into the video signal, as shown at step 420. A dummy picture is 
an MPEG picture which is merely a repeat of a particular I frame or a non-1 
frame. Notably, however, the discrete cosine transform (DCT) coefficients and 
the motion vectors of the dummy picture are set to zero. Thus, dummy pictures 
require very little storage space on the medium. Further, dummy pictures are 

t5 already in a compressed format and, therefore, do not have to be re-encoded 
prior to being recorded onto the storage medium. 

In one arrangement, dummy pictures can be placed either before or after 
each frame in the video signal being altered; however, the invention is not so 
limited, as the dummy pictures can be inserted anywhere in the video signal. 

20 The number of dummy pictures inserted into the video signal depends on the 
selected slow motion speed. For example, a single dummy picture can be 
inserted either before or after each frame in the video signal, including each I 
frame that has been re-encoded into an I field and P field picture, to produce a 
playback speed that is one-half of normal playback speed. FIG. 4E illustrates 

25 this example. A slower playback speed requires the insertion of a greater 
number of dummy pictures. 

The invention is not limited to adding dummy pictures to the video being 
edited to create slow motion playback. As shown in step 422, an alternative 
arrangement exists in which one or more repeat pictures can be inserted into the 

30 video signal for purposes of slow motion editing. A repeat picture is an 
uncompressed picture that is a duplicate of its parent picture. 
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If repeat pictures are to be added, then one or more such pictures can be 
inserted into the video being edited at step 424. Similar to the process of 
inserting dummy pictures, the number of repeat pictures added to the video can 
be determined by the desired playback speed, i.e., a slower playback speed 
5 requires a greater number of pictures to be added. Moreover, the repeat pictures 
can be inserted anywhere in the video being edited. As an example, FIG. 4E, in 
addition to illustrating the insertion of dummy pictures for a one-half speed 
playback, also represents the result of adding repeat pictures to produce a one- 
half speed playback. Once the repeat pictures are inserted, these pictures can 
10 be re-encoded, as shown at step 426. Thus, in accordance with the inventive 
arrangements, one or more dummy pictures, one or more repeat pictures or a 
combination thereof can be inserted into the video being edited to produce slow 
motion playback. 

After the dummy and/or repeat pictures are placed in the video signal (and 

15 the repeat pictures re-encoded), one or more new GOP's can be created, as 
shown in step 428 in FIG. 4A. This is because the number of pictures in the 
portion of video being edited has increased, and industry standards limit the 
number of display fields that a GOP can contain to thirty-six. This equates to a 
maximum of eighteen frames per GOP. Although up to thirty-six fields, or 

20 eighteen frames, can be placed in either the original GOP or the newly created 
GOP's, an equal number of pictures is preferably placed in each GOP thereby 
enabling each GOP to undergo further processing, if desired, in order to conform 
to the conventional GOP structure. FIG. 4F shows an example of this result. 

The new GOP's can now be recorded onto the storage medium, as shown 

25 in step 430. In accordance with the inventive arrangements, the edited video 
can be placed in the same space that the original video previously occupied. 
This is because any dummy pictures that have been placed in the video require 
very little storage space since they do not contain any encoded image 
information. Further, encoded repeat pictures typically contain only slight 

30 amounts of encoded information since they are identical or substantially identical 
to their parent pictures. Moreover, whatever storage space is required to fit 
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these pictures into tine original space can come from the space on the storage 
medium that was used to store the deleted non-video information. 

In one arrangement, however, if there is not enough room on the storage 
medium, then a certain number of pictures that have not been re-encoded into I 
5 frames or I field and P field pictures can be decoded. Once decoded, these 
pictures can be re-encoded to reduce their picture resolution. Such a process 
reduces the amount of storage space required for the pictures. In an alternative 
arrangement, the bit rate of the video signal can be lowered as the video is being 
placed onto the storage medium. Although lowering the bit rate can result in the 

10 loss of some of the video data and a corresponding reduction in picture 

resolution, such a process enables the edited video signal to fit in the original 
recording location. 

In an alternative embodiment, one or more of the GOP's containing the 
edited video can be re-encoded to match a conventional GOP structure. Re- 

15 encoding the new GOP's Into a conventional GOP structure produces a smoother 
playback and improves trick mode performance. To do so, a number of the 
pictures in the GOP's can be decoded and then subsequently re-encoded into 
different formats. As an example, referring to FIG. 4F, Bo and Bd of GOPi do not 
have to be decoded and then re-encoded since a conventional GOP typically 

20 begins with two B frames. Continuing with the example, Bi, however, can be 
decoded and re-encoded into field pictures h and Pi. These field pictures can 
now serve as the reference frame for GOPi. This process can continue until the 
structure of the GOPi and GOP2 matches a conventional structure, as shown in 
FIG. 4G. It should be noted, however, that the foregoing discussion is merely an 

25 example, as any other suitable sequence can be used to re-encode one or more 
of the GOP's in the edited video into conventional GOP's. 

FIG. 5 A shows a flowchart 500 that illustrates an alternative arrangement 
in which slow motion editing can be performed. FIGS. 5 A through 5G illustrate 
an example of this type of editing. Similar to flowchart 400, data can be read 

30 form the storage medium at step 510 and non-video components can be 
removed from the video at step 512. FIG. 5B shows a GOP prior to being 
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edited. In this arrangement, however, all the pictures can be decoded prior to 
adding dummy or repeat pictures, as shown in step 514. Once decoded, one or 
more of the I frames can be re-encoded into I and P field pictures, as shown in 
step 51 6 and FIG. 5C. Continuing with step 516, one or more other non-1 
5 frames may also be re-encoded into an I frame or I and P field pictures so that 
the new GOP's created by the editing process will each have a reference frame. 
FIG. 5D shows an example of this process. 

Once the selected pictures have been re-encoded, dummy pictures may or 
may not be the pictures inserted into the video to be edited, as shown in step 

10 518. If not, then, based on the desired playback speed, one or more repeat 
pictures can be inserted into the video at step 520. FIG. 5E illustrates an 
example of this process for one-half speed playback. Once the repeat pictures 
are inserted, new GOP's can be created, as shown at step 522 and Illustrated in 
FIG. 5F. At step 524, the GOP's can then be re-encoded to match a 

15 conventional GOP structure. FIG. 5G shows an example of this process. 

Moving back to step 518 of FIG. 5A, if dummy pictures are to be added 
to the edited video, then one or more new GOP's can be created based on the 
desired playback speed, as shown in step 528. FIG. 5H shows an example of 
this process. As pictured, two GOP's are created for purposes of producing 

20 one-half speed playback. A slower playback speed requires the creation of a 

greater number of GOP's. Each GOP can carry one or more of the frames from 
the video about to be edited. As will be explained below, it is preferable to 
place frames strategically such that inserting the dummy pictures can lead to a 
conventional GOP structure. It should be noted, however, that FIG. 5H is 

25 merely an example of this process, as the frames can be placed in any other 
suitable order. 

Once the GOP's have been created, the original pictures in the video can 
be re-encoded, as illustrated at step 530. Subsequently, at step 432, one or 
more dummy pictures can then be added to the GOP's. Since they are already 
30 compressed, the dummy pictures do not have to be re-encoded. As shown in 
FIG. 51, the type of dummy picture inserted in a specific location in a GOP is 
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preferably a type that leads to the GOP having conventional GOP structure. For 
example, a dummy Bd picture can be inserted between B4 and Pb, as a 
conventional GOP typically contains two B pictures between I and P frames or 
between P frames. It should be noted, however, that the invention is not limited 
5 in this regard, as any other suitable insertion sequence can be used, including 
one that does not match a conventional GOP structure. Once the dummy 
pictures are added, at step 526, the edited video can be recorded on the storage 
medium. 

Similar to the procedure of inserting pictures discussed in flowchart 400, 
10 the resolution of the pictures in the edited video signal can be reduced or the bit 
rate can be lowered if there is not enough room to fit the edited video in its 
original location on the storage medium. This applies to the process of adding 
repeat or dummy pictures. 
- Referring to FIG. 6A, a flowchart 600 illustrates two ways how fast 

!5 motion editing can be performed. FIGS. 6B through 6F illustrate an example of 
each of these fast motion editing processes as applied to two GOP's to create a 
double speed playback; however, it should be noted that the invention is not so 
limited, as any portion of video may be changed to playback at any speed faster 
than normal playback. In step 610, the device 100 can begin to read data from 
20 the storage medium. In step 612, the demultiplexer 176 of FIG. 1 can separate 
the video component of the recorded video signal from the non-video 
components, such as A PCK's 40 and SP PCK's 42. The non-video 
components can then be discarded. Similar to the slow motion process of FIGS. 
4A and 5A , the NV PCK's 38 can be left in the video signal being edited. FIG. 
25 68 shows two conventional GOP's as they enter the packet video encoder 144. 

As shown in step 614, if the edited video will not undergo a re-encoding 
step to conform each edited GOP to a conventional GOP structure, then the 
packet video encoder 144 can begin to remove B frames from the video signal. 
This process is shown at step 616 in FIG. 6A and in FIG. 6C. Referring to FIG. 
30 60, it is preferable to remove B frames in a non-successive manner. That is, 
once a B frame is removed, the device 1 00 can then retain one or more B 
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frames (based on the desired playback speed) before deleting another B frame. 
Deleting B frames nonsequentially will produce a smoother playback and trick 
mode performance. As an example, in FIG. 6C, frames Bo and Bi can be 
removed and then frame Ba can be retained before frames B*. Be and B? are 
5 deleted. Subsequently, frame Ba can be retained and the deletion process can 
continue. It should be noted, however, that the example shown in FIG. 6C is 
not intended to limit the invention to this particular deletion sequence, as any 
other suitable deletion sequence may be used. 

The overall number of pictures deleted from the video signal depends on 

10 the selected fast motion speed. For example, to produce a playback speed 

twice as fast as normal playback, one-half of the pictures contained in each GOP 
can be deleted from the video signal. This is the result achieved in FIG. 6C. At 
step 618 in FIG. 6A, the video encoder 144 can determine whether removal of 
the B frames was sufficient for purposes of producing the desired fast-forward 
playback speed. If not, then the video encoder 144 can begin to remove P 
frames from the video, as shown in step 620. In one arrangement, the first P 
frame to be removed can be the last P frame contained in each GOP being 
edited; however, the invention is not so limited as any other P frame can be the 
first P frame deleted. As in the case of B frame removal, deletion of P frames is 

20 preferably done in a nonsequential order. 

Once the proper number of pictures have been deleted, the remaining 
pictures from the edited GOP's can be consolidated to fill one or more of the 
GOP's contained in the edited video signal, in accordance with step 622 and as 
illustrated in FIG. 60. These pictures can then be recorded onto the storage 

25 medium, as shown in step 624 in FIG. 6A. In contrast to the slow motion 

editing process, the fast-forward edited video can easily fit in its original storage 
medium space since one or more pictures have been deleted from the video. In 
one arrangement, dummy data can then be recorded over the remaining medium 
space, as shown in step 626. This process can prevent the recorder from 

30 displaying parts of the original video which still remain on that portion of the 
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medium not receiving the edited video. The dummy data can conveniently be 
ignored by the device 1 00. 

Turning back to step 614, if the edited GOP's are to be re-encoded to 
match the structure of a conventional GOP, then it is irrelevant as to which 
5 pictures are deleted from the video signal; however, similar to the previously 
discussed fast-forward editing process, it is preferable to delete frames in a 
nonsequential order for purposes of creating a smoother playback. FIG. 6D 
illustrates two GOP's before they are edited. Moving back to FIG. 6A, at step 
615, the pictures that make up the video signal can be decoded by the packet 

1 0 video decoder 1 78 and can then be transferred to the packet video encoder 1 44. 
The packet video encoder 144 can then begin to remove pictures from the 

~ video, as shown in step 617. The number of pictures that are deleted can be 
based on the desired fast-forward playback speed. FIG. 6E illustrates this 
process as applied to two GOP's to produce a doubled playback speed. It 

15 should be noted, however, that the example shown in FIG. 6E is not intended to 
limit the invention to this particular deletion sequence, as any other suitable 
deletion sequence may be used to create the desired playback speed. 

: At step 619 of FIG. 6A, the remaining pictures can be consolidated, and 

these pictures can then be re-encoded to match the structure of a conventional 

20 GOP, as shown in step 621 of FIG. 6A and FIG. 6F. It should be noted, 
however, that the example shown in FIG. 6F is not intended to limit the 
invention to this particular re-encoding sequence, as any other suitable re- 
encoding sequence may be used. At step 623, once the pictures have been re- 
encoded, the pictures can be recorded onto the storage medium in the space 

25 previously occupied by the original video. In addition, dummy data can then be 
inserted into any remaining medium space, as shown in step 626. 

FIG. 7A is a flowchart 700 that illustrates another arrangement in which 
fast-forwarding editing can be performed. FIGS. 7B through 7D illustrate an 
example of this particular fast motion editing process as applied to two GOP's to 

30 create a double speed playback; however, it should be noted that the invention 
is not limited by this example, as any portion of video may be changed to 
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playback at any speed faster than nornna! playback according to this particular 
arrangement. Similar to flowchart 600, in step 710 of FIG. 7A, the device 100 
can begin to read data from the storage medium. In step 712, the demultiplexer 
176 of FIG. 1 can separate the video component of the recorded video signal 
5 from the non-video components. The non-video components, except for any 
navigation data, can then be discarded. Next, the pictures that make up the 
video signal can be decoded by the packet video decoder 1 78 and can then be 
transferred to the packet video encoder 144, as shown in step 714. FIG. 7B 
illustrates two GOP's as they enter the video encoder 144. 

10 In this arrangement, however, a number of fields can be deleted from the 

video signal based on the desired fast-forward playback speed, as shown in step 
716 of FIG. 7A. FIG. 7C illustrates such a process where the desired playback 
speed is double that of normal playback speed. As pictured, a field has been 
removed from each frame that comprises the video signal. It should be noted, 

1^5 however, that FIG. 7C is merely an example, as any other playback speed can 
be achieved and any other suitable deletion sequence can be used to achieve a 
particular speed. Moreover, it is preferable, when applicable, to delete fields in a 
nonsequential manner. 

As shown in step 718 of FIG. 7A and FIG. 7D, the remaining fields can 

20 then be consolidated, and at step 720 of FIG. 7A, these fields can be re- 
encoded. Similar to the fast-forward editing of FIG. 6A, the fields can be re- 
encoded to match the structure of a conventional GOP. The fields can be re- 
encoded into field pictures, as shown in FIG. 7D. Alternatively, the fields can be 
combined and re-encoded into non-progressive frames. The field pictures, or 

25 frames, can be recorded onto the storage medium in the space previously 

occupied by the original video, as shown in step 722. In addition dummy data 
can be inserted into any remaining space, as shown in step 724. Although any 
combination of field pictures may be removed to create the desired playback 
speed, removing field pictures as illustrated in FIGS. 7B through 7D will produce 

30 a smoother playback as well as improved trick mode performance. 



